LoadingLoading
Statistical significance is a judgment made by analysts that results in data are not due solely to chance. Statistical hypothesis testing is the method analysts use to make this judgment.
Statistical significance is a judgment made by analysts that results in data are not due solely to chance. Statistical hypothesis testing is the method analysts use to make this judgment. This test provides a p-value, which is the probability of observing an outcome as extreme as the data, assuming that the outcome is indeed due to chance.
Generally, a p-value of 5% or less is considered statistically significant.
Statistical significance is a judgment against the null hypothesis, which states that the result is due to random factors alone. When the p-value is small enough, the data set is considered statistically significant.
When the p-value is large, the results can be explained by chance and the data are considered consistent with the null hypothesis, although this does not prove that the null hypothesis is correct.
When the p-value is small enough, usually 5% or less, the results are not easily explained by chance and the data are considered inconsistent with the null hypothesis. In this case, the null hypothesis is rejected, usually in favor of a more systematic explanation. [1]
IMPORTANT NOTE: Statistical significance is commonly used to test effectiveness in new drug trials, vaccine testing, and pathology studies. This can provide investors with a reference on the success rate of a company's new product launches.
Suppose financial analyst Alex is concerned about whether some investors are informed of a company's sudden failure in advance. Alex decided to compare the average daily market returns before and after the company's collapse to determine if there was a statistically significant difference between the two means.
The p-value for this study was 28% (>5%), indicating that differences like the ones observed (-0.0033 to +0.0007) are not uncommon when explained by chance alone. Therefore, the data do not provide strong evidence that anyone knew in advance that the company would fail.
If the p-value is 0.01%, which is well below 5%, then the observed differences would be highly anomalous if explained by chance alone. At this point, Alex may decide to reject the null hypothesis and further investigate whether any traders had advance knowledge of the information.
Statistical significance is also used in testing new medical products, including drugs, devices and vaccines. Publicly released statistical significance reports also provide investors with information about a company's success rate of new product launches.
Suppose a leading diabetes drug company reports that its new insulin shows statistically significant reductions in diabetes in testing. The trial lasted 26 weeks and randomized treatment in patients with diabetes, and the data showed a p-value of 4%. This shows investors and regulators that the data does show a statistically significant reduction in diabetes. [2]
Pharmaceutical company stock prices are often affected by statistically significant announcements of their new products. [3]
Statistical hypothesis testing is used to determine whether data are statistically significant and whether a phenomenon can be explained as a by-product of pure chance. Statistical significance is a judgment against the null hypothesis, which states that a result exists only due to chance. Rejection of the null hypothesis is necessary for the data to be considered statistically significant.
The p-value is a measure of the probability that the observed difference is due to random factors alone. When the p-value is small enough (5% or less), the results are not easily explained by chance and the null hypothesis can be rejected. When the p-value is large, the data can be considered consistent with the null hypothesis, thereby proving the null hypothesis to be correct.
Statistical significance is often used to test the effectiveness of new medical products, including drugs, devices and vaccines. Publicly available statistical significance reports also provide investors with information about the success of a company's new product launches. Pharmaceutical company stock prices are often significantly affected by announcements of statistically significant new products. [4]
Statistical significance is the result of a hypothesis test, yielding a p-value or the likelihood that two or more variables are due to non-random causes. Typically, a p-value of 5% is considered a cutoff. The lower the p-value, the more statistically significant the results of the data set are.
This form of testing is often used to evaluate drug trials, and investors, especially those looking to evaluate companies launching new products, will also benefit from it.
[1] Tenny, Steven and Abdelgawad, Ibrahim. "Statistical Significance." StatPearls Publishing, 2023.
[2] American Diabetes Association. "Efficacy and Safety of Fast-Acting Aspart Compared With Insulin Aspart, Both in Combination With Insulin Degludec, in Children and Adolescents With Type 1 Diabetes: The Onset 7 Trial."
[3] Hwang, Thomas J. "Stock Market Returns and Clinical Trial Results of Investigational Compounds: An Event Study Analysis of Large Biopharmaceutical Companies." PLOS ONE, 2013.
[4] Rothenstein, Jeffrey, et al. "Company Stock Prices Before and After Public Announcements Related to Oncology Drugs." Journal of the National Cancer Institute, vol. 103, no. 20, October 2011, pp. 1507-1512.
TheQuantHackers is a cutting-edge community composed of a group of people from the world's top universities and quantitative finance practitioners, dedicated to exploring the infinite possibilities in the fields of artificial intelligence (AI) and quantification (Quant). Our team members come from world-renowned universities such as the University of Cambridge, Oxford University, Harvard University, ETH Zurich, Peking University, and the University of Science and Technology of China. Our external consultants come from first-class companies such as Microsoft, HSBC, Citadel, Man Group, Citi, Jump Trading, and top domestic private equity companies.
Upgrade to unlock all institutional-grade algorithms, derivative pricing engines, factor backtesting frameworks, and live QuantLab execution.
Explore Membership Access
Pre-order · £490Quantitative analytics platform
Waitlist closed — signal locked. Pre-order TQH TERMINAL now at £490 with launch-day delivery.